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Abstract. Systems with a long-term stationary state that possess as a spatio- 
temporally fluctuation quantity /3 can be described by a superposition of several 
statistics, a " superstatistics" . We consider first, the Gamma, log- normal and F- 
distributions of /3. It is assumed that they depend only onpi, the probability associated 
with the microscopic configuration of the system. For each of the three /?— distributions 
we calculate the Boltzmann factors and show that they coincide for small variance of 
the fluctuations. For the Gamma distribution it is possible to calculate the entropy in 
a closed form, depending on pi, and to obtain then an equation relating pi with j3E[. 
We also propose, as other examples, new entropies close related with the Kaniadakis 
and two possible Sharma-Mittal entropies. The entropies presented in this work do 
not depend on a constant parameter q but on pi . 

For the pj-Gamma distribution and its corresponding B Pl (E) Boltzmann factor and 
the associated entropy, we show the validity of the saddle-point approximation. We 
also briefly discuss the generalization of one of the four Khinchin axioms to get this 
proposed entropy. 



PACS numbers: 05.70.-a, 05.70.Ln, 89.70.Cf 
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1. Introduction 

Several measures of information have been proposed in the literature PQ, appart from 
Shannon entropy [2]. By maximizing these information measures j3], their correspond- 
ing probability distributions can be calculated. Some of these generalized information 
and entropy measures and their potential physical applications have been discussed [I] . 

Also, by considering non equilibrium systems with a long-term stationary state that 
possess a spatio- temporally fluctuating intensive quantity, more general statistics were 
formulated, called Superstatistics [5]. The temperature was selected as a fluctuating 
quantity among various available intensive quantities. An extensive discussion exists in 
the literature analyzing the possible viability of these kind of models to explain several 
physical phenomena [U E]. For general distributions f((3), one can get an effective 
Boltzmann factor. 



where E is the energy of a microstate associated with each of the considered cells. 
The ordinary Boltzmann factor is recovered for f((3) = 5(f3 — (3 ). One can, however, 
consider other distributions for the temperature that will lead to their corresponding 
Boltzmann factors. The Gamma (x 2 ), log-normal and the F-distributions were studied 
in this context as well as their corresponding Boltzmann factors. The analysis of these 
B(E) showed that all these statistics present the same behaviour for small variance of 
the fluctuations. 

In [7j a new formalism was developed to deduce entropies associated to each one 
of the above mentioned Boltzmann factors B(E) arising from their corresponding f((3) 
distributions. Following this procedure, the Boltzmann- Gibbs entropy and the so called 
non-extensive statistical mechanics, Tsallis entropy S q (corresponding to the Gamma 
distribution (x 2 ) and depending on a constant parameter q) were obtained. For the log- 
normal, F-distribution and other distributions it is not possible to get closed analytic 
expression for their associated entropies and the calculations were performed numerically 
utilizing the corresponging B(E) in each case. 

All these f{f3) distributions and the Boltzmann factors B(E) obtained from them, 
depend then on a constant parameter q, actually the F-distribution also depends on a 
second constant parameter. Consequently the associated entropies depend on q. 

In this work we are proposing new generalized distributions, Boltzmann factors 
and information entropies depending on pi. It is not our purpose in this first setting 
of these new structures to discuss their possible physical consequences or applications. 
This is left for future work. As shown, these new proposals depending on p\ resemble 
the already well known f((3), B(E) and information entropies depending on q which 
possible applications and limitations, in relation with certain physical systems, have 
been discussed in the literature jH EJ |8]. 




(1) 
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In Section [21 we will propose f(/3) distributions that do not depend on an arbitrary 
constant parameter (the F-distribution will also be considered, it will depend now on 
one constant parameter instead of two, as usual), but instead of pi that can be identified 
with the probability associated with the microscopic configuration of the system. We 
will calculate the associated Boltzmann factors. It will be shown that for small variance 
of the fluctuations a universal behaviour is exhibited by these different statistics. 

In Section [3], we use the new Gamma (x 2 ) distribution, depending on p h and 
its associated Boltzmann factor to calculate the entropy; some of these calculations 
were already presented in {9]. We will maximize this information entropy to get the 
corresponding {p{\ probability distribution. In our model, the entropy resembles the 
one proposed in non-extensive statistical mechanics resulting also by assuming a (x 2 ) 
distribution. In our case, however, it does not depend on a free constant parameter q, 
but instead on the probability pi. We will show that this new entropy can be expanded 
in a series, which first term corresponds to Shannon entropy [2] . 

In Section HI we will consider other well known information entropies [TJ that can be 
generalized and the new proposed entropies will not depend on the constant parameter 
q, but on the probability pi in each case. As examples we will consider the p\ modified 
Kaniadakis and Sharma-Mittal entopies, that, as expected, will have also the Shannon 
entropy first term when expanded in series. 

To complete this work we analyze two further aspects, the validity of the saddle- 
point approximation [TQl [TTj, [12] , and following jH [13], [H] we also discuss a generalized 
version of the Khinchin axioms. As shown in jl], three of these axioms are kept and 
the fourth of them is replaced by a more general version proposed in [13] , obtaining the 
Tsallis entropy. We will study these two aspects only for the Boltzmann factor B Pl (E) 
and its associated entropy, arising from the proposed p^-Gamma distribution. For the 
other entropies we will not discuss these two features. However, by example, for these 
entropies a similar procedure to that followed in [H] could be worked out in relation 
with an extension of the Khinchin axioms. 

Section [5] is dedicated to discuss the saddle-point approximation [12]. We will 
consider it in relation to the Boltzmann factor B pi (E) arising from the p;-Gamma 
distribution. In Section [6j we discuss how one can replace the fourth Khinchin axiom [4] 
to get a set of axioms from which the entropy proposed here follows. As mentioned, this 
entropy is obtained from the Boltzmann factor Bpi(E) and this one from the p;-Gamma 
distribution. Section [7] is devoted to Discussion and Outlook. 

2. Generalized distributions and their associated Boltzmann factors 

We begin by assuming a Gamma (or \ 2 ) distributed inverse temperature depending 
on pi, the probability associated with the microscopic configuration of the system. We 
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may write these pi Gamma distributions as 



(3 1 



l-p. 



(2) 



where Pq is the average inverse temperature. Integration over /3 yields the generalized 
Boltzman factor 

B Pl (E) = (l+ Pl f3 E)-^, (3) 
as shown in [5], this kind of expression can be expanded for small piftoE, to get 
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The log-normal distribution can also be written in terms of p\ as 
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The generalized Boltzmann factor ([T]) can be obtained in leading order, for small variance 
of the inverse temperature fluctuations, 



B Pl {E) 



-fS E 



1 Q2 z-i2 1 2 1 



l + lp^E 2 -^pt(p l + 3)P 3 E 3 + 



(6) 



In general, the F-distribution has two free constant parameters. In [5], the authors 
considered, particularly, the case in which one of these constant parameters is chosen 
as v — 4. For this same value of this constant parameter we define a F-distribution in 
function of the inverse of the temperature and pi as 
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Once more the associated Boltzmann factor can not be evaluated in a closed form, but 
for small variance of the fluctuations we obtain the series expansion 
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(8) 



Beck and Cohen j5] have demonstrated that all superstatics depending on a constant 
parameter q are the same for sufficiently small variance of the fluctuations. For our 
proposed distributions El IZJ) depending now on p h the corresponding Boltzmann 
factors ( 141161 also satisfy these conditions. 
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3. Entropy from the Boltzmann factor 

The examples studied in [5] have been nicely addressed in [7] in order to deduce 
the entropies from their corresponding Boltzmann factors. Another possible way to 
reconstruct the entropy has been proposed in [15], [16] , this provides other expressions 
and consequently predicts different physical consequences. In [T7j it has been shown 
that there exist a duality between these two procedures. We will refer to the first 
proposal, as shown there [7J, the Boltzmann-Gibbs entropy and the non-extensive 
statistical mechanics entropy can be obtained in a closed analytic form. However, the 
entropies corresponding to the Boltzmann factors associated to the log-normal and to 
the F-distributions can not be obtained analitically and were calculated numerically. 
Following [7J and a previous work by one of us [9] we present the procedure to obtain 
the entropy corresponding to our f((3) distribution fl2]) and to its associated generalized 

Q 

Boltzmann factor ([3]). We begin by defining the entropy S = ^s(pj) in terms of a 

i=i 

generic s(pi); for s(x) = — xlnx one has the Shannon entropy. As in [7J it is possible to 
express s(x) and as well a generic u(x) in terms of integrals on a function E(y) that is 
obtained from the Boltzmann factor B(E) of interest. By these means s(x) and u(x) 
can be written as 



u\x) 



;i+a/B,) fr^|)7F • < 10) 



r x , a + E(y) 
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v ; Jo y l-E{y)/E* ' v ' 

and 

dy 
E{y)/E* 

where E(y) is to be identified with the inverse function of B PI (E)/ J °° dE' B Pl {E'). One 
selects first the f(j3) of interest, then B(E) is calculated and the integral J °° B(E') dE' 
is performed. Inverting the axes of the variables, E(y) for several superstatistics can be 
found [5], and from it E*. In our case, the starting points are the distribution ([2]) and 
the Boltzmann factor (j3J). E(y) results in 

E{y) = y —± , (11) 
x 

E* = — -. A straightforward calculation gives for u(x) 

u( x ) = x x+1 , (12) 
where a has been determined by means of the condition u(l) = 1; s(x) results in 

s{x) = l-x x . (13) 

Expressions ([T2j [J3]) fulfill the conditions s(0) = 0, w(0) = and u(l) = 1, s(l) = 0. By 
these means the entropy results in 

S = kJ2(l- P r), (14) 
1=1 
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where k is the conventional constant and J^pz = 1. The expansion of ( fl4l) gives 



1=1 
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the first term corresponds to Shannon entropy. 

In the functional 

o n n 

$ = T-7Ew-/3Epf +1 ^ 
ft /=i z=i 



(16) 



7 and /3 are Lagrange parameters. 

Considering the appropiate s(x) and u(x) and imposing the condition |^ = it 
is possible to calculate pi, as it is known for the Shannon entropy j2] and for the non 
extensive statistical mechanichs [TJ [7] . In our case by means of (Eqs. [T2lfT4|) one gets 

l + lnpi + /3Ei(l+pi+pi\npi) =p^ p \ (17) 

As we have shown in the expansion of the entropy the dominant term is the first one 
corresponding to the Shannon entropy, for it one gets the usual expression for pi namely 
pi = e~ l3oEl . We cannot analytically express p\ as function of /3Ei for the model we are 
considering. We can however, plot a figure of f3Ei as function of pi and invert the axes 
to get pi = f((3Ei). By means of this procedure we are able to plot Figured] for different 
values of (3Ei. We notice that for relative large values of (3E[ the usual values for pi 
coincide with the ones given by ffTT|) . As expected they coincide also for p\ approaching 
one. 
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Figure 1. Comparison of the two probabilities, 
one pi = e~P E \ and - - line to pi = f{(3Ei) 



line corresponds to the standard 



As we have shown by choosing f Pl (/3) (EJ) , B Pl (E) (j3J) is obtained by integrating over 
/3 and from it by inverting the axes of the variable the inverse function E(y) (1111) and E* 
are found. This procedure has allowed us to calculate u(x) and s(x) and consequently 
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the entropy fjl4H5|) . If we assume in f Pl ((3) (j2J) a pi = ~, that is equipartition, the 
distribution takes the form 



n-i 



/3f2 



I3 T (fi) V /9o / 
and we get the Boltzmann factor 

B n (E) = (l + (3/n)- n , 

from this the entropy results in 



S = kQ 



1 - 



(18) 



(19) 



(20) 



as Boltzmann's entropy is Sb = fclnfl, the expansion of expression fl2U|) in terms of Sb 
gives 
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(21) 



Figures [2] and [3] show the Boltzman entropy Sp/k and the entropy S/k. We notice 
that in the range of " small" Q (large equipartition probabilities) these entropies differ. 
Instead for large Q the two entopies basically coincide. 
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Figure 2. Entropies as function of ft. and 

and S/k respectively (pi — I/O equipartition) 



lines correspond to Sp/k 



We have then proposed a new entropy fll4f20p that does not depend on a constant 
arbitrary parameter, but on the probability pi ( ITT)) associated with the microscopic 
configuration of the system. Its expansion provides as a first term the Shannon entropy 
( fl5l) and correspondingly Boltzmann's entropy ( 12 lj) . This entropy corresponds to 
the Gamma distribution (I21TT8]) . Other two distributions ( 15JT)) were also assumed as 
functions of and their approximated corresponding Boltzmann factors found ( loTISl . 
As mentioned, their associated entropies can not be expressed in an analytic closed 
form. 
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Figure 3. Entropies as function of il. 
S/k respectively (pi = equipartition) 
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4. Other generalized information entropies in terms of p\ 

More general measures of information than the Shannon entropy have been proposed in 
the literature pp. Maximizing these entropies subject to suitable constraints allow us to 
obtain associated probability distributions. In jU El E] several of these entropies have 
been reviewed and their potential physical applications discussed. 

Similar entropies, to most of those studied in [4], but now in terms of pi, can 
be proposed. As examples let us consider modified Kaniadakis and Sharma-Mittal 
entropies. The Kaniadakis entropy is defined by the expression 



n i+k _ i-K 

s H =-ky:- — — • 

V 2k 



(22) 



This is an entropy, which reduces to the original Shannon entropy for k = 0]. Inspired 
in this Kaniadakis entropy we propose to consider the following generalized entropy 



S 



Pi 



(23) 



the two terms in this expression can be expanded in a similar manner as ( fl~4lfl~5l) to get 

(pi In pif 



S n 

T = J2p^ u pi 
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(24) 



The first term corresponds to Shannon entropy. It is interesting to notice that the 
expansion (|24"I) of the entropy (|23|) differs from the expansion (fT5|) of the entropy (fT4T) 
corresponding to the Gamma distribution ([2]) and that we have analyzed in more detail 
in the previous sections; in (1241) only the "odd" terms in the expansion arise. 

We consider now the Sharma-Mittal entropies, these are two constant parameters 
families of entropic forms. They can be written as 



2k 
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We now assume that k and r are not constant parameters but are functions only of pi, 
we get the entropy (TH|) for —2k = pi and r = y + 1 and the entropy fl23|) is obtained for 
r = 1 and k = p\. These Sharma-Mittal entropies can be generalized in several manners 
as functions of the probability p\ by means of other different assumptions. Two of 
them correspond to the entropies (I14f23p in this work. Other entropies considered, by 
example in jl], can also be generalized as functions of pi instead of a constant parameter 
q. As examples we have analyzed the pi dependent generalized Kaniadakis and two 
Sharma-Mittal entropies that reduce to the entropies ( jT4f23l) . 



5. The saddle-point approximation, the prGamma distribution case. 

We have already obtained the low energy asymptotics (jl]) for the Boltzmann factor 
(jHJ) arising from the p;-Gamma distribution (j2j). We have also shown that up to second 
order the Bolztmann factor corresponding to the log-normal distribution (jSJ) and the 
Boltzmann factor (jSj) arising from the F-distribution (JTj) concide with the Boltzmann 
factor (Tj0). These approximations represent the leading order correction to ordinary 
statistical mechanics in the nonhomogeneous systems with temperature fluctuations for 
small values of the energy E. The zeroth-order approximation to these Boltzmann 
factors corresponds, as expected, to the Boltzmann statistics B(E) ~ eP oE with inverse 
temperature (3 . 

To find the high-energy asymptotics of B(E) we follow [12] where the fact is used 
that (Jl]) has the form of a Laplace integral for E — > oo. In this limit, the integral 
can be approximated by its largest integrand. This is the essence of the saddle-point 
approximation, namely the Laplace method. The conditions of applicability of this 
approximation method are basically the conditions that one assumes regarding the shape 
of /(/3) and its differenttiability. By putting B Pl (E) in the form 

/•DC 

B Pl {E) = / e-P E+laf ^dp, (26) 
Jo 

one attempts to find the unique value of (5 which maximizes the exponential function 

V(f3,E) = -f3E + \nf(f3), (27) 

for any large enough energy value E. The value of (3 maximizing ^({3, E) for large fixed 
E is denoted (3e- Having assumed f((3) to be unimodal ensures us the uniqueness of 
Pe- Being f(/3) unimodal, ln/(/3) must be a concave function of /3. In this manner the 
maximum of ^f(j3, E) can only be obtained at the single point It is such that 

In this way we get 0e and in the limit E — > oo 

B Pl (E) ~ = f (p E ) e -^ E . (29) 
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This saddle-point or Laplace approximation can be improved by using a Gaussian 
approximation of the integrand in (1261) . The refined high energy asymptotics results 
in 

B Pl {E)~ MML^l . (30) 

The approximation of B(E) (I29 | 130]) show that the mixture of Boltzmann statistics 
defining B(E) reduces at high energy E to a particular Boltzmann statistics, like in 
the equilibrium situation, but now this Boltzmann statistics is a function of (3e which 
depends on E, the energy considered and is determined by f Pl {0) (1251) . The long 
term stationary behaviour of the non equilibrium system considered for high values 
of E is dominated by the equilibrium behaviour of a subset of cells having an inverse 
temperature close to f3 E . We now consider the asymptotic behaviour of B pi (E) (jTJ for 
E — > oo and f Pl {(3) given by (jSJ). We first solve fl28|) to find (3e for this case. One gets 

h ~ Eifa + l' (31) 
as expected [12] as E — > oo, (3e — > 0. We want now to calculate B Pl (E) ff29|) for this 
Pe- This can be expressed as 

B (E) - 1 -^[ln^+ln(jSp,ft,+l)+l] (32) 

For E — > oo and a certain value of p\ 

B pi (E) ~ e~^n LXnE ~ E 1 '^. (33) 



The more refined approximation ( 1301) can be obtained by dividing ( 1331) by 
y — [In fpXfiE)}" which in the high energy limit is proportional to E. In this way 

B Pl {E)~E~ 1 ^. (34) 

In this more accurate calculation, we get, asymptotically a decaying power law for the 
effective Boltzmann factor. As mentioned in [T2] power law superstatistics seem to be 
physically relevant for several physical systems. 



6. An appropiate information measure 

The well established four Khinchin axioms are nicely well discussed and presented in 

n 

[1]. As known, the celebrated Shannon [2] entropy S = —k^^pilnpi satisfies all these 

i 

axioms. It has been however, argued in the literature that the fourth of these axioms is 
not an obvious property [HDSlCEl]. We will concentrate our discussion on it. This fourth 
axiom deals with the composition of two systems I and II (not necessarily independent). 
We denote the probabilities of the first system as p\ , those of the second system as pj 1 . 
The joint system is described by the joint probabilities p\f x = p{p n where p n (j\i) 



Generalized information entropies depending only on the probability distribution 



11 



is the conditional probability of event j in system II under the condition that event i has 
already ocurred in system I. The conditional information of system II formed with the 
conditional probabilities p H (j\i) is denoted by I({p n (j\i)}), under the condition that 
system I is in the state i. The fourth axiom states that the conditional informations are 
related by 

KW 1 }) = n{pl})+T,pln{p n (M})- (35) 

i 

This axiom postulates that the information measure should be independent of the way 
the information is collected. We can collect the information in II, assuming a given event 
i in system I, and then sum the result over all possible events i in system I, weighting 
with the probabilities p\. If the two systems are independent the probability of the two 
systems factorizes plf 1 = pip 1 / ■ Only in this case (1351) reduces to 

I({plf I ) = I({p I l }) + H{p 1 /}), (36) 

the rule of additivity of information for independent systems. From a physical point of 
view this axiom (1351) is not an obvious property. Should the information be considered 
as independent from the way we collect it? In complex systems, the order in which the 
information is collected can be very relevant. This has lead to the replacement of the 
fourth Khinchin axiom by something more general. In particular in [13] it was shown 
that Tsallis entropy follows uniquely by replacing only the fourth axiom ( 135]) by the 
more general version 

S 1 / 1 = S J q + SW - (q - 1) (37) 

The meaning of this new axiom is that if we collect information from two subsystems, 
the total information should be the sum of the information collected from system I 
and the conditional information from system II, plus a correction term. Apriori this 
correction term can be anything. One restricts the possible asumptions to 

S T > n = S 1 + S 1111 + giS 1 , 5 /7|/ ), (38) 

where g is some function. One of the simplest forms is of the kind given by fl37|) . We 
may as well, formulate another axioms which then lead to other possible information 
measures. This is the case, by example, in [Hj where a set of axioms has been assumed 
that lead to the Sharma-Mittal entropy. 

The entropies (HM associated with the pi-Gamma distribution (T5]) are composable. 
Suppose the two systems I and II are not independent. In this case one can still 
write the joint probability product of pi and the conditional probability p{j\i), 

the probability of event j under the condition that event i has already ocurred is 

Pij =p{j\i)Pi- 

Then the conditional entropy associated with system II, under the condition that 
system I is in state i, is (k — 1) 
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One can then verify the condition 




'i, a 



(40) 



This relation is similar to the original axiom four fl35|) . one has however the probability 
with an exponent that is the probability itself. We weight now the events in system 

1 with p?' instead of pi. Hence, the pi dependent information considered ( 1T4"1) is not 
independent of the way it is collected for the various subsystems. 

7. Discussion and Outlook 

The distributions (l2"f5"fT|) . Boltzmann factors (ISflTIBTIS]) and entropies (I14ll20f23|l2"5l) 
proposed in this work do not depend on a constant parameter q, but all are functions of 
Pi (for the F-distribution the remaining constant parameter has been chosen v — 4). By 
maximizing the functional ( !T6|) . for the entropy ( ]T4"|) a closed relation between pi and j3Ei 
has been obtained ( !T7l) . It has been shown that for small variance of the fluctuations, 
the Boltzmann factors (j4"f6f8]) concide for the following distributions: Gamma fl2]) , log- 
normal ([5]) and F -distributions ([7]). Moreover, the generalized information entropies 
proposed in this work f fT4"|23f25!) can be expanded to get as a first term the Shannon 
entropy (I15|24p . We have analyzed the saddle point approximation for the p^-Gamma 
distribution and have got, in the high energy limit, an asymtotically decaying power 
law for the effective Boltzmann factor (|3~4"1) . this seems to be the physically expected 
appropiate behaviour [12]. We have also shown how the fourth Khinchin axiom should 
be modified so that the associated entropy results in ( |T4l) . In figure 1 we have compared 
the probability distribution arising from this entropy with the standard one. In figures 

2 and 3 we have compared (for Pi — hi equipartition) the entropy (|2"Uj) with the 
Boltzmann entropy. In this first proposal of these new entropies we do not analyze 
physical systems in which these entropies could possibly be of interest. As shown, the 
new entropies (I14II23|25I) resemble the well known non-extensive statistical mechanichs 
entropy, the Kaniadakis and two Sharma-Mittal entropies correspondingly (other well 
known q entropies could also be generalized in terms of pi). For all these, depending on a 
constant parameter q, there exist an extensive literature on their possible physical reach, 
their relation with the experiments is under discussion [H El IE]- Also, other theoretical 
developments have been proposed [151 EH E] • We will study, in further work, some of 
the pi dependent entropies proposed here in connection with these aspects. 
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